Long Chaotic Transients in Complex Networks 
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We show that long chaotic transients dominate the dynamics of randomly diluted networks of pulse-coupled 
oscillators. This contrasts with the rapid convergence towards limit cycle attractors found in networks of globally 
coupled units. The lengths of the transients strongly depend on the network connectivity and varies by several 
orders of magnitude, with maximum transient lengths at intermediate connectivities. The dynamics of the 
transient exhibits a novel form of robust synchronization. An approximation to the largest Lyapunov exponent 
characterizing the chaotic nature of the transient dynamics is calculated analytically. 
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The dynamics of complex networks 01 is a challenging 
research topic in physics, technology and the life sciences. 
Paradigmatic models of units interacting on networks are 
pulse- and phase-coupled oscillators |2]. Often attractors of 
the network dynamics in such systems are states of collective 
synchrony HE HSHIIHIkIGjIQ- Motivated by syn- 
chronization phenomena observed in biological systems, such 
as the heart |3] or the brain |13], many studies have inves- 
tigated how simple pulse-coupled model units can synchro- 
nize their activity. Here a key question is whether and how 
rapid synchronization can be achieved in large networks. It 
has been shown that fully connected networks as well as arbi- 
trary networks of non-leaky integrators can synchronize very 
rapidly |5|, |8|]. Biological networks however, are typically 
composed of dissipative elements and exhibit a complicated 
connectivity. 

In this Letter, we investigate the influence of diluted net- 
work connectivity and dissipation on the collective dynamics 
of pulse-coupled oscillators. Intriguingly, we find that the dy- 
namics is completely different from that of globally coupled 
networks or networks of non-leaky units, even for moderate 
dissipation and dilution: long chaotic transients dominate the 
network dynamics for a wide range of connectivities, render- 
ing the attractors (simple limit cycles) irrelevant. Whereas the 
transient length is shortest for very high and very low con- 
nectivity, it becomes very large for networks of intermediate 
connectivity. The transient dynamics exhibits a robust form 
of synchrony that differs strongly from the synchronous dy- 
namics on the limit cycle attractors. We quantify the chaotic 
nature of the transient dynamics by analytically calculating an 
approximation to the largest Lyapunov exponent on the tran- 
sient. 

We consider a system of TV oscillators 0] that interact 
on a directed graph by sending and receiving pulses. For 
concreteness we consider asymmetric random networks in 
which every oscillator i is connected to an other oscillator 



j : =/= i by a directed link with probability p. A phase variable 
4>j(t) S [0, 1] specifies the state of each oscillator j at time t. 
In the absence of interactions the dynamics of an oscillator j 
is given by 



d(f>j(t)/dt= 1. 



(1) 
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When an oscillator j reaches the threshold, (f)j(t) = 1, its 
phase is reset to zero, 4>j{t + ) — 0, and the oscillator emits a 
pulse that is sent to all oscillators i possessing an in-link from 
j. After a delay time r this pulse induces a phase jump in the 
receiving oscillator i according to 

M(t + T )+) :=min{t/- 1 (C/(^(t + r))+£y)>l} (2) 

which depends on its instantaneous phase (f>i(t + r), the ex- 
citatory coupling strength £y > 0, and on whether the input 
is sub- or supra-threshold. The phase dependence is deter- 
mined by a twice continuously differentiable function U{<j>) 
that is assumed to be strictly increasing, U'(4>) > 0, concave 
(down), U"{4>) < 0, and normalized such that U(0) = and 

u(i) = i (cf. id). 

This model, originally introduced by Mirollo and Stro- 
gatz 01, is equivalent to different well known models of in- 
teracting threshold elements if U (<fi) is chosen appropriately 
(cf. I14ln . The results presented in this Letter are obtained for 
Ub{4>) = b^ 1 ln(l + (e b — 1)0), where b > parameterizes 
the curvature of U, that determines the strength of the dissipa- 
tion of individual oscillators. The function U approaches the 
linear, non-leaky case in the limit lim^o Ub{4>) = <f>- Other 
nonlinear choices of U ^ Ub give results similar to those re- 
ported below. The considered graphs are strongly connected, 
i.e. there exists a directed path from any node to any other 
node. We normalize the total input to each node Y^jLi £ ij = e 
such that the fully synchronous state (</>j (t) = (pa (t) for all i) 
exists [12]. Furthermore for any node i all its ki incoming 
links have the same strength = e/ki . 

Numerical investigations of all-to-all coupled networks 
(p = 1) show rapid convergence from arbitrary initial condi- 
tions to periodic orbit attractors (cf. Isl Ullo . in which several 
synchronized groups of oscillators (clusters) coexist la ll ill . 
In general we find that the transient length T, i.e. the time the 
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Figure 1: Long chaotic transients towards periodic attractor states in complex networks. The panels show the dynamics of random networks 
of N = 100 oscillators (b = 1.0, e — 0.1, r = 0.1). The phases of all oscillators are marked along the vertical axis just after an arbitrary 
but fixed reference oscillator is reset. Time is thus measured by the number of resets n of the reference oscillator. The length of the transients 
increases quickly with dilution: (a) for the fully connected (p — 1) network the transient length is T ~ 10 2 , whereas (b) T ~ 2 ■ 10 3 for 
p = 0.97 and (c) no attractor reached up to n = 10 5 (T > 10 5 ) forp = 0.80. 
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Figure 2: Typical transients in complex networks are very long. Dis- 
tribution of transient lengths on randomly diluted networks (N = 16, 
p = 0.8, b — 3, e = 0.1, r — 0.1, histogram of 300 random net- 
works). 



system needs to reach an attractor, is short for all-to-all cou- 
pled networks and depends only weakly on network size, for 
instance T « 10 2 for N = 100 oscillators [see e.g. Fig.^a)]. 

In contrast to fully connected networks, diluted networks 
exhibit largely increased transient times: eliminating just 3% 
of the links (p = 0.97) leads to an increase in T of one order of 
magnitude [T « 10 3 , Fig.^b)]. The system finally settles on 
an attractor which is similar to the one found in the fully con- 
nected network, i.e. a periodic orbit with several synchronized 
clusters. Further dilution of the network causes the transient 
length to grow extremely large [T > 10 5 , Fig.^c)]- The life- 
time of an individual transient typically depends strongly on 
the initial condition. We observed the dynamics started from 
many randomly chosen initial phase vectors distributed uni- 
formly in [0, 1]^ and typically find a wide range of transient 
times (Fig.|2ji. 

We systematically studied the average transient length in 
dependence on the average connectivity p. Surprisingly the 
average transient length, a dynamical feature of the network, 
depends non-monotonically on the network connectivity p 
(Fig. |3]), whereas many structural properties of random graphs 
such as the av erag e path length between two vertices are 
mono tonic in p 1 15]. The average transient length is short for 
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Figure 3: The average transient length (T) depends non- 
monotonically on the network connectivity p. The longest transients 
are found for intermediate connectivities. Average over 100 initial 
conditions (N = 16, b = 3, e = 0.1, r = 0.1). Error bars are 
standard error of mean. The inset shows the rapid growth of (T) 
with network size iV (boxes: p = 0.8, stars: p = 0.95, diamonds: 
p = 1.0). 

low and high connectivity values p, but becomes very large 
for intermediate connectivities, even for only weakly diluted 
networks. Moreover we find that the mean lifetime (T) grows 
exponentially with the network size N for diluted networks 
whereas it is almost independent of network size for fully- 
connected networks (inset of Hig - EJ . This renders long tran- 
sients the dominant form of dynamics for all but strongly di- 
luted or fully connected networks. The transient length de- 
fines a new, collective time scale that is much larger than 
the natural period, 1, of an individual oscillator and the de- 
lay time, r, of the interactions. This separation of time scales 
makes it possible to statistically characterize the dynamics on 
the transient (cf. 1 16]). 

What are the main features of the transient dynamics? We 
determined the statistical distribution of phases of the oscilla- 
tors during the transient. Interestingly the oscillators exhibit a 
novel kind of synchrony during the transient: most of the units 
form a single, roughly synchronized cluster (Fig. |4ji. This 
cluster is robust in the sense that it always contains approxi- 
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mately the same number of oscillators with the same spread 
of relative phases although it continuously absorbs and emits 
oscillators. On the attractor, however, the oscillators are orga- 
nized in several precisely synchronized clusters (cf. Fig. @}, 
such that the transient dynamics is completely different from 
the dynamics on the attractor. 

Numerically we find that nearby trajectories diverge expo- 
nentially with time, an indication of chaos [Fig. [2 a)]. To fur- 
ther quantify the chaotic nature of the transient dynamics, we 
determined the speed of divergence of two nearby trajecto- 
ries both by numerical measurements and by analytically es- 
timating the largest Lyapunov exponent on the transient. Let 
{t n : n G No } be a set of firing times of an arbitrary, fixed ref- 
erence oscillator and (f>\{t n ), (j>f(t n ), i G {1, . . . , N}, the set 
of phases of all oscillators i of two transient trajectories 1 and 
2. We then define the distance 
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(3) 



between these two trajectories at time t n where | • | c denotes 
the distance of two points on a circle with circumference 1. 
For a small initial separation D C 1 at time to the distance 
D n at later time t n scales like [Fig.|5Ja)] 
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quantifying the speed of divergence by the largest Lyapunov 
exponent A. To analytically estimate A, we determine the 
phase advance of oscillator i evoked by a single pulse received 
from oscillator j, 



13 > 



(5) 



where we have used the definition of Ub(<fi) in Eq. (0 and 
considered only sub-threshold input. We obtain 



exp(beij) > 1 



(6) 



independent of the delay r and the constants cy which are 
independent of cf>j (t). The magnitude by which a single pulse 
increases the difference \<fil(t + ) — (j>f(t + )\ c — a,ij\(f>}(t) — 
4>1 (t)\ c is thus only determined by ay. If an oscillator i re- 
ceives exactly one pulse from all its upstream (i.e. presynap- 
tic) oscillators between t n and t n +i, the total increase due to 
all these pulses is determined by 



N 



exp 



N 



(7) 
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Figure 4: The oscillators form a single, slightly dispersed cluster dur- 
ing the transient (black) and several precisely synchronized clusters 
on the attractor (grey). The figure shows the density of phases of the 
oscillators relative to their average phase. Data shown for the dynam- 
ics displayed in Fig.0b) averaged over n — 500 . . . 1500 (transient) 
and n = 2500 . . . 3500 (attractor). 




Figure 5: (a) The distance D„ between two nearby trajectories grows 
exponentially with time n. The slope of the dashed line quantifies 
the rate of divergence measured by the largest Lyapunov exponent 
A. The jumps at n — 16 and n = 29 are due to the choice of the 
reference oscillator, (b) The largest Lyapunov exponent A depends 
linearly on the curvature b of the interaction function Ub- These 
numerical results (disks with error bars) agree with the analytical 
prediction A = b ■ e (continuous line) 1 17]. Error bars denote the 
standard deviation for 100 random networks (N — 100, p — 0.75, 
e = 0.1, r = 0.1). Inset: interaction function Ub{<f>) for b — 1 and 
6 = 5. 



The normalization Xy=i £ u = £ implies Ai — exp(fe) =: 
A for all oscillators i. Noting that the network is in an 
asynchronous state during the transient and assuming that be- 
tween t n and t n+ i each oscillator fires exactly once we find 
D n+ i w AD n . The largest Lyapunov is then approximated 
by 



A « bxA 



(8) 



Numerical results are in good agreement with Eq. l|8} for 
intermediate values of b [| 17], see Fig. [2b)]. Note that there 
is no free parameter in Eq. (|8j. This calculation shows that 
the curvature b of Ub and the coupling strength e strongly in- 
fluence the dynamics during the transient by determining the 
largest Lyapunov exponent. To further characterize the dy- 
namics we investigated return maps of inter spike intervals 
(i.e. the time between two consecutive resets of individual os- 
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cillators). This analysis revealed broken tori in phase space 
(not shown). Moreover we find that the correlation dimen- 
sion flill of the transient orbit is low (e.g. D colT w 5 for 
N = 100, p = 0.96 and b = 3, e = 0.1, r = 0.1). This indi- 
cates that the chaotic motion during the transient takes place 
in the vicinity of quasiperiodic motion on a low dimensional 
toroidal many fold in phase space. Interestingly quasiperiodic 
motion was also found in fully-connected networks of similar 
integrate-and-fire oscillators [19]. 

How do the long chaotic transients come into existence? As 
a first step towards answering this question we investigated in 
which region of parameter space long chaotic transients occur. 
It turned out that they do not sensitively depend on parame- 
ters but prevail for a substantial region of parameter space in 
randomly diluted networks. The region covered by long tran- 
sients in parameter space (not shown) is similar to that cov- 
ered by unstable attractors for fully connected networks (cf. 
lHHo . As, in general, long chaotic transients often occur in 
situations like crises or attractor destructions 1 20], we conjec- 
ture that long transients occur in this system because diluting 
the network converts unstable attractors that prevail in phase 
space into unstable (presumably non-attracting) periodic or- 
bits, inducing sensitive dependence on initial conditions and 
thus chaotic transient dynamics. The interesting open ques- 
tion about the dynamical origin of the transient needs further 
investigation. 

In summary, we described a novel type of dynamics in com- 
plex networks of pulse-coupled oscillators: long chaotic tran- 
sients. These transients dominate the dynamics for a wide 
range of parameters and become prevalent for large networks, 
thus rendering the dynamics on the attractors irrelevant to the 
observed behavior. This is in stark contrast to the rapid con- 
vergence found in fully connected networks as well as in net- 
works of non-leaky elements. The transient length defines a 
new, collective timescale that is not present in the single unit 
dynamics. Interestingly it is maximal for intermediate con- 
nectivities in contrast to many structural network properties. 
The transient dynamics exhibits a rapid and robust form of 
synchronization: the oscillators form a roughly synchronized 
cluster. For the transient dynamics we approximately calcu- 
lated the largest Lyapunov exponent analytically; this is rarely 
possible for any high dimensional system. The approximation 
is in good quantitative agreement with the exponential diver- 
gence of nearby trajectories found in numerical simulations. 

Previous studies on the synchronization dynamics of pulse- 
coupled oscillators have focused on globally coupled net- 
works or on systems of individual elements without dissipa- 
tion (see e.g. jfJIH)- Our results show that the combination 
of dissipation and complex connectivity can create a qualita- 
tively distinct network dynamics. More generally, our results 
emphasize that the network's structure can have a major im- 



pact on its dynamics, as small structural changes induce fun- 
damentally different forms of behavior. This is very likely to 
occur not only in networks of coupled oscillators but in many 
other complex networks, too. 

This research was supported in part by the National Science 
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